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Abstract 



Recent CDF and DO measurements of B®-B® mixing make it possible to search 



| for CP violation and test CPT symmetry in a variety of B s decays. Considering 

^ \ both coherent B^B® decays at the T(4S') resonance and coherent B^B® decays at 

the T(5S) resonance, we formulate their time-dependent and time- integrated rates 
by postulating small CPT violation in B®-B® and B®-B® oscillations. We show 

. that the opposite-sign dilepton events from either C-odd or C-even B^B® states 

(for q = d or s) can be used to determine or constrain the CPT-violating parameter 
at a super-i? factory. The possibility of distinguishing between the effect of CPT 
violation and that of AB = —AQ transitions is also discussed. 
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1 Introduction 



A correlated P°P° system, where P may be either K, D, B d or B s , has been of great 
interest for the study of CP, T and CPT symmetries in particle physics. In the K°-K° 
mixing system, for instance, both indirect CP violation [1] and direct CP violation [2] 
have unambiguously been observed; the evidence for T violation [3] has been achieved; and 
CPT invariance has been tested to an impressive degree of accuracy [4]. The AQ = AS 
rule has also been examined in the semileptonic K° and K° transitions. Beyond the 
K°K° system, both indirect and direct signals of CP violation have been observed in a 
number of neutral B d decays [4]; and possible CPT violation in B d -B d mixing has been 
searched for at the KEK and SLAC fi-meson factories [5]. Although the phenomena of 
CP violation have not been seen in the B° s -B° s and D°-D° mixing systems, they may show 
up and even surprise us in the near future at the LRC-B [6] , r-charm [7] and super- B [8] 
factories. 

The CDF [9] and DO [10] Collaborations have recently reported their measurements 
of B®-B® mixing (both the mass and width differences between the light and heavy B s 
mass eigenstates) at the Fermilab Tevatron Collider: 

AM S = 17.77 ± O.lO(stat) ± 0.07(syst) ps" 1 (CDF [9]) , 
Ar s = 0.13 ± 0.09 ps- 1 (DO [10]) . (1) 

This remarkable progress in experimental B physics makes it possible to search for CP 
violation and test CPT symmetry in the B®B° S system. As the magnitude of B Q S -B Q S 
mixing is much larger than that of B d -B d mixing [4], its impact on the time-dependent 
and time- integrated rates of B® and B° s decays deserves attention. In particular, the CP- 
and CPT- violating signals might get enhanced or suppressed due to large B®-B® mixing. 
At a super- B factory with the luminosity C ~ a few x 10 36 cm _2 s _1 [8], both coherent 
B d B d decays at the T(4S) resonance and coherent B° S B° S decays at the T(5S f ) resonance 
will be studied down to the last detail. 

The main purpose of this work is to formulate the decay rates of a correlated B®B® 
state (either q = d or q = s) in the assumption that there are both small CPT violation in 
Bq-B® oscillation and small AB = AQ violation in semileptonic B® and B® decays. Note 
that possible effects of CPT violation in neutral B d and D decays have been analyzed in 
Refs. [11, 12, 13] and Refs. [14, 15], respectively; and possible effects of AB = —AQ and 
AC = —AQ transitions have been discussed in Ref. [16] and Ref. [17], respectively. The 
present paper is different from the previous ones not only because we are dealing with 
a new heavy meson-antimeson mixing system (i.e., the B° S B° S system) but also because 
our discussions are essentially new in two aspects. (1) We shall take into account both 
C-odd and C-even B®B® pairs with C being the charge-conjugation parity of this coherent 
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system, and calculate both time-dependent and time-integrated rates of (B q B q ) c decays 
by assuming slight CPT violation and small AB = —AQ effects. Our analytical results 
are more general and more useful than those obtained in Refs. [11]— [16] . (2) We shall 
concentrate on the opposite-sign dilepton asymmetries of (B q B q ) c decays to investigate 
possible effects of CPT violation and AB = —AQ transitions. It is worth remarking that 
an opposite-sign dilepton event may be either Ifl^ (for Z x ^ l 2 ) or . Although the 
opposite-sign dilepton events of (B®B®) C decays have been considered in Refs. [12, 13], 
our results for the B° s -B° s mixing system have their own features and implications due to 
the small CP- violating phase of B Q S -B® mixing and the large values of AM S and Ar s . 

So far some interest has been paid to the possibilities of exploring CP violation and 
probing new physics in weak B s decays at the Y(5«S) resonance [18]-[21], although the 
experimental feasibility remains an open question. We expect that the future super-S 
factory can run at this interesting energy threshold [22]. Then it will be possible to test 
CPT invariance in both B^-B^ and B®-B® oscillations by studying the coherent B®B® 
and B®B® decays. 

2 CPT violation in coherent (B^B^) C decays 

The mixing or oscillation between B® and B q mesons can naturally arise from their com- 
mon coupling to a subset of real and virtual intermediate states. Hence the mass eigen- 
states \B L ) and |-B H ), where "L" ("H") denotes "light" ("heavy"), are different from the 
flavor (weak interaction) eigenstates \B q ) and \B q ). Taking account of both CP- and 
CPT- violating effects in B q -B q mixing, one may parametrize the correlation between 
{\B L ), \B H )} and {\B° q ), \B°)} states as follows: 

\B L ) = cos d -e-^\B°)+sin 9 -e^\B°), 

\B K ) = sm 9 -e-^\B° q )-cos 9 -e^\B° q ), (2) 

where and <fi are in general complex. For simplicity, the normalization factors of \B h ) 
and \B H ) in Eq. (2) have been omitted. CPT invariance requires cos# = or equivalently 
= it/2, while CP conservation requires both = it/ 2 and = [23] 2 . The proper-time 

2 As CPT violation may simultaneously imply the violation of Lorentz covariance in a quantum field 
theory [24], the dependence of 6 on the sidereal time should in general be taken into account [25]. For 
simplicity, here we take 9 as a constant by assuming that the boost parameters of and mesons 
are small and the corresponding Lorentz violation is rotationally invariant in the laboratory frame. In 
this approximation, our results are valid as averages over the sidereal time, such that the effect of 
Lorentz violation due to the direction of motion can be neglected. A complete analysis, which requires 
incorporating Lorentz- violating parameters directly into the phenomenology to account for possible CPT 
violation [26] , is beyond the scope of this paper and will be done elsewhere. 
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evolution of an initially pure \B q ) or \B q ) state is given by [11] 

= e-(^> \g + (t)\B°) + ~9 + (t)\B° q ) 



where 



B°M)) = e<™ + V* \g4t)\m + g_(t)\&)] , (3) 



g± (t) = cosh [ lX \ Vq rt \ ± cos 9 sinh ( lXq Vq Vt 




~g ± (t) = sin 9e ±l<p sinh q * q Tt) . (4) 



The definitions in Eqs. (3) and (4) are M = (M L + M H )/2, T = (r L + r H )/2, x q = AM q /T 
with AM, = M H - M L , and y 9 = Ar,/(2r) with AT q = T L - T H , where M L H (r L>H ) 
denotes the mass (width) of B L H . Taking account of 1/r w 1.52 ps [10], we approximately 
obtain x s 27 and y s 0.1 from the central values of AM S and Ar s given in Eq. (1). In 
contrast, x d ps 0.78 [4] has been known but y d has not been measured for the B^-B® mixing 
system. We stress that the experimental values of x d , x s and y s are in good agreement 
with the standard-model predictions [27] 3 , although the uncertainty associated with y s 
remains quite large. 

In order to calculate the proper-time distribution of coherent (B q B q ) c decays, we 
neglect the tiny final-state electromagnetic interactions and assume CPT invariance in 
the direct transition amplitudes of semileptonic or nonleptonic B q and B q decays. Such 
an assumption can be examined, without the mixing-induced complexity, by detecting the 
charge asymmetry of semileptonic B ± decays [12]. We shall take into account possible 
AB = —AQ transitions in our calculations. The latter can be described by using a small 
parameter a t for a given semileptonic decay mode, 

(l+X^\H\B° q ) = At, (l+X^\H\B° q ) = aA; 

(rX+\H\B° q ) = , (rX+\H\B° q ) = a*A* , (5) 

where a l measures the AB = — AQ effect and \a t \ 1 is expected to hold. \a t \ ^ 
implies that it is in practice impossible to have a pure tagging of the B q or B q state 
through its semileptonic decay (to l + X[~ or l~X^). In general, the amplitudes of B q 
and B q decays into the final-state f i (either semileptonic or nonleptonic) are denoted as 
A f = {fi\H\B q } and A f = (fi\H\B°). When the coherent {B° q B° q ) c -> fj 2 decays are 
concerned, the following combinations 

ic = e-» + Cj*-^ , ( c = -± + C-± , (6) 

Jl J2 J2 Jl 



3 Notc that y d w 0.002 and y s w 0.06 •••0.08 are the updated predictions [27]. The theoretical 
expectation x s /x d <~ y s /y d ~ 35 has partly been confirmed by current experimental data. 
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where C = ±1, will be frequently used. 

Now let us consider a correlated B q B q state at rest. Its time-dependent wave function 
can be written as 



1 

72 



W(K, t))\B°(-K, t)) + C\B°(-K, t))\B°(K, t)) 



(7) 



where K is the three-momentum vector of B q and B q , and C — ±1 is the charge- 
conjugation parity of this coherent system. If one of the two B q mesons (with momentum 
K) decays to a final state j x at proper time t 1 and the other (with — K) to f 2 at t 2) the 
amplitude of their joint decays is given by 

Mfi,h;f 2 ,t 2 ) c = ±= e-^+SX'^) {A f A fa [g + (ti)~9-(t2) + C~g_(h)9 + (t2) 



+ A /A 2 
+ A h A f 2 



ff + (*l)ff-(* 2 )+Cff-(*l)ff + (*2) 
^ + (*l)^-(* 2 )+Cff-(*l)^+(*2) 

5 + (ii)5-(i2) + C^_(i 1 )^ + (t 2 )]} 



(8) 



The calculation of the decay rate R(f 1) t l ] f 2 ,t 2 ) c oc ^(/^t^ / 2 ^2)cl 2 i s straightforward 
but lengthy. Our result is 

R(fx,tx\Mc « l^/J^/J 2 ^ [(l^cl 2 + ICd 2 ) cosh (y ff n c ) 

- (Kcl 2 - Kol 2 ) cos - 2Re (£Cc) smh 



+2Im (£Cc) sin (x q Ft c ) + V (A, t l5 f 2 , t 2 ) c 



(9) 



where t c = t 2 + Ct 1 is defined, £ c and C c have been given in Eq. (6), and V(f 1 ,t 1 ; f 2 , t 2 ) c 
denotes the CPT-violating term: 



V(f 1 ,t 1 ;f 2 ,t 2 )_ = 



-2Re 
-2Re 
+2Re 
-21m 

+ 



cosh [ygTt 
cos (x q Ft_ 
sinh (y q rt_) 



sin (x Tt_ 



+ 



LC + CC+) cos 9 

(im 2 +cc+) cos^; 

(ie-| 2 -CC + ) cos^ 
£_ (C_ + C-) I cos 0|e + "« R i cos (x q Yt 2 - 6 
(C_ - C-) I cos 9\e~y^ cos (x q Tt 2 + Q 

C (£_ - c_) I cos%+^ cos (x,ri! - e_) 

f- (f- + C-) I cos fl|e-^ r *2 cos (^r*! + 0+) 



with 



tan6 ± = 



Im 


£- (e ± c) 


cos # 


Re 




cos# 



(10) 



(11) 
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or 



V(A,t i; / 2 ,t 2 ) + = +2Re(C_C; cos^) cosh (y q Yt 

+2Re (^_C; cos 9) cos (x q Ft + 



-2Re^_C + cos9)smh[y q Tt + 



+2Im cos 9) sin fa^rt 



+ 



+ 



(e + - c + ) (e_ + c 
(e + + C + ) (i - c_) 
(*+ - C + ) {i - C-) 

(e + + c + ) + c 



cos^|e + ^ r *i cos (x q rt 2 + 0_ + ) 
cos9\e' y ^ cos (x q tt 2 - + _) 
cos9\e +y ^ cos (xgF^ + 0__) 
cos^|e^ r * 2 cos (xgF^ - + 



with 



tan 



Im 


± c;) 




cos # 


Re 


(i: ± c;) (e. ± c) 


COS # 



(12) 



(13) 



We observe that the CPT- violating term has a more complicated time-dependent be- 
havior than the CPT-conserving term. For completeness, the time-integrated form of 

R(fi,t 1 ;f 2 ,t 2 ) c is s iven b y 



R{h,f 2 ) c oc \A f f\A f2 



1 + Cy\ 



ic\ 2 + \Cc\ 2 ) 



Cxi 



(l + xl)' 



(l£cl 2 - Kcl 2 ) 



2(1 + C7)y fi 



Re (£Cc) + 



(i - vi) 

where the CPT- violating term reads 
V(A,/ 2 )_ = --^Re[(CC + CC + )cos^ 

Vq 



2(1 + C)x g 
(l+a-) 2 



Im(^Cc) + 2V(A,/ 2 ) c 



, (14) 



Re (C_C cos 0) + x^Im cos 0)] , (15) 



or 



v(A,/ 2 ). 



+ 



1 + 2/, 



.(l-^ 2 ) (1+^) 
22/, 



Re(e_C;cos^) 



(i-y 2 )' 

2a;„ 



^l+J/f 
l + x2 



(l+^) 2 I"?/ 2 



Re(£_£cos0) 
Im (£_£cos0) 
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yi) 



Re (^_C+ cos 0) + x g y g Im cos 6) 



(16) 



When CPT is a good symmetry (cos^ = 0), Eqs. (9) and (14) are in agreement with the 
formulas obtained in Refs. [15, 28]. 

We stress that Eqs. (9)-(16) are new results and may serve as the master equations 
for the study of CPT violation in coherent (B q B q ) c decays. They are also valid for other 
correlated meson-antimeson systems with CPT violation, in particular useful to describe 
coherent (D°D°) C decays at the ^(3770) and ^(4140) resonances. 



3 Example: opposite-sign dilepton events 

To be specific, we consider a particularly simple and interesting possibility of testing CPT 
invariance in B q -B q mixing: the opposite-sign dilepton events from coherent (B q B q ) c 
decays. One may take f\ = IfXi and f 2 = l 2 X 2 with either / x = l 2 (e.g., l x = l 2 = a0 
or l x 7^ l 2 (e.g., l ± — e and l 2 — ji). The amplitude of each semileptonic decay mode can 
be parameterized in analogy with Eq. (5). Since the AB = —AQ transitions must be 
strongly suppressed, it is reasonable to take \a l \ <C 1 (for i = 1 or 2) in our calculations. 

i 

We first look at the C — — 1 case. By simplifying Eqs. (9), (10) and (11), we obtain 
the time-dependent rates of (B q B q )_ — > {lfXf) t ^{l^X 2 ) t2 decays as follows: 

R^X-^X+.t^ oc \A h \ 2 \A h \ 2 e- vt + [cosh^Hj + cos(x q Ft_) 

+2Refi smh(y q Tt_) + 2Imfi sin(a:,n_)] , 

R(l^X+,t 1 ;l+X 2 ,t 2 )_ oc \A h \ 2 \A h \ 2 e- Tt + [cosh{y q Vt_) + cos(^H_) 

-2Rensinh(y ? n_) - 2Imnsin(x ? n_)] , (17) 

where t± — t 2 ±t 1 , and 

n = cose + a h e +i<1, -al 2 e~^ , U = cos 9 - a\(T^ + a x e^ (18) 

have been defined by keeping the leading terms of CPT violation and AB = —AQ effects. 
Note that e i(p = {V t * b V ts ) / (V tb V t * s ) w 1 + 2i\ 2 r] holds for B° s -B° s mixing described by the 
box diagrams in the standard model, where A ~ 0.22 and 77 0.34 are the Wolfenstein 
parameters [4]. If e ±w ^ ~ 1 is taken in the leading-order approximation, Eq. (18) can be 
simplified to Q cos9+(a l —a* ) and ps cos 9— (a* — cr z ). If / 1 = l 2 is further taken, then 
we have Q ~ Q ~ cos 9 + 2Tm(o"^). It is remarkable that the same simplification cannot 
be made for the B%-B% mixing system, where e 1 ^ = (V t * b V td ) / (V tb V t * d ) e~ 2l/3 with (3 ps 22° 
being one of the inner angles of the Cabibbo-Kobayashi-Maskawa unitarity triangle in 
the standard phase convention [4]. Of course, e 1 ^ might deviate from the standard-model 
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expectation if B q -B q mixing (for q = d or s) involves a kind of new physics. The latter 
has also been included into the parameters Q and Q. Thus these two parameters serve for 
an effective description of possible new physics (CPT violation, AB = —AQ transitions 
and new AB = 2 effects) in B q -B q mixing. 

Eqs. (17) and (18) clearly show that the AB = —AQ parameters have the same time- 
dependent behavior as the CPT-violating parameter cos 6? in the opposite-sign dilepton 
events of the correlated B q B q state with C = — 1. Hence it is in general impossible to 
distinguish between the effect of CPT violation and that of AB = —AQ transitions in this 
kind of events, unless one of them is remarkably smaller than the other. If the decays of 
the correlated B q B q state with C — +1 are taken into account, however, it is in principle 
possible to cleanly extract the CPT-violating parameter [13]. To illustrate this point in a 
transparent way, we simplify Eqs. (9), (12) and (13) to obtain the time-dependent rates 
of (B° q B° q ) + -> (lfX^) ti (qxt) t2 decays. The result is 



R(lfX 1 ,ti,l 2 X 2 ,t 2 ^j 
R (l x Xf, ti, l 2 X 2 , t 2 ) 



oc \A, 



-rt_, 



cosh(y St.) + cos(x St , 



-2Refi'sinh(y St + ) - 2ImQ' sin(x q Tt + ) + 2A(i 1 ,f 2 



oc |A I 



\A, 



-rt_, 



cosh(y St.) + cos(x St , 



where Q' 



o l e +i(t> + at e 



-2Refi smh(y q Vt + ) - 2\mTt s\n(xSt + ) - 2A(t 1 ,i 2 )J , (19) 
and ff = of + a l e +i,t> do not contain the CPT-violating 



effect, but A(t l ,t 2 ) is purely a CPT-violating term: 



A(M 2 ) 



+ 



cos(x 9 rt 1 ) sinh(y g rt 2 ) — sinh(y ri-J cos(x g rt 2 ) Re(cos #) 
sin(x T^) cosh(?/ 9 rt 2 ) — cosh(y ri-J sm(xSt 2 ) Im(cos#) 



(20) 



One can easily see that A(t 2 ,t 1 ) = —A(t 1: t 2 ) holds, but the CPT-conserving terms in 
Eq. (19) do not change with the exchange of t 1 and t 2 . This interesting feature implies 
that A(t 1 ,t 2 ) can in principle be extracted from the rate differences 

R(ltX^ ^-l^Xt ,t 2 ) + - R(l+X^ ,t 2 ,l 2 Xt + oc 4|4 i | 2 |4 2 |V r ' + A(t 1 ,t 2 ) , 
P(/rX 1 + ,t 2 ;/ 2 + X 2 -,t 1 ) + -P(/rX 1 + ,t 1 ;/ 2 +X 2 -,t 2 ) + oc 4| \ | 2 | \ \ 2 e - rt + A(t,, t 2 ) . (21) 

As Im0 m is a good approximation for B q -B q mixing in the standard model, we have 
Ref/ ~ Ref2' and Imfi' « — Imfi'. In this case, Imf2' can in principle be extracted from 
the rate differences 



R fcx+, t i; ltX 2 , t 2 ) + -R (/+Xr, t 2 ; Z 2 -X+, t ± ) + oc 4| AJ 2 | AJ^+W , 
R^Xt^l+X^t,) -P(/+Xr,t i; / 2 -X 2 + ,t 2 ) oc 4|A i | 2 |^J 2 e- r * + M / . (22) 
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For B Q S -B® mixing with e 



j^ 2 *^, we obtain Imf2' 



the dilepton events of coherent {B q ) B ] 



1 ^ 1, Imf2' pa Imcr^ — Ima^ holds; and for B®-B% mixing with 
(Rea^ — Recr z ) sin 2/3 — (Imcr^ — IiiktJ cos 2/3. Thus 
qBq) + decays are very useful to probe possible CPT 
violation and AB = —AQ effects. 

If the forthcoming super-5 factory is also an asymmetric e + e~ collider as the present 
KEK and SLAC 5-meson factories, it will be easier to measure the proper-time difference 
t_ = (t 2 — ti) of a dilepton event. A measurement of the t + = (t 2 +t\) distribution might 
be difficult in either linacs or storage rings, unless the bunch lengths are much shorter than 
the decay lengths [29] . Hence we may calculate the t_ distribution of the dilepton events 
by integrating R{lfXf, t 1 ; l^X 2 , t 2 ) c over t + . For simplicity, here we assume AB = AQ 
to be a perfect rule and use t to denote t_. We take t > by convention. Our results are 



R(ltX?,$X±t)_ oc \\\ 2 \A l2 \ 2 e- vt [cos%,n)+cos(a;,rt) 



±2Re(cos#) sinh(y Ft) ± 2Im(cos#) sin(x Ft) 



(23) 



and 

R(lfX?,$X±,t) 



+ 



oc 



IA l 2 l 



A \ 2 e~ rt 



cosh(y Ft + (p ) cos(x Ft + p 



+ 



l + xl 



±- 



2|cos#| 



cos (6 



) e +y q rt _ cos (@ + UJ _ + x rt) 



21 cos#| 



T- 



p q + (2 - y q ? 

cos(0 - uj + )e~ y i rt - cos(0 x q Ft) 



y/x q + V + V q Y 



(24) 



where the parameters tp x , tp , ou± and @ are defined through ta,np x 



x 



tanh </? 



9' 



tanw_|_ = x q /(2 ± y ) and tan@ = Im(cos#)/Re(cos#), respectively. Taking x s ~ 27 and 
y s ~ 0.07 for example, we have <^ x ~ 1.53, </? ~ 0.07, w + ~ 1.49 and cj_ ~ 1.50; while 
taking x d ~ 0.78 and y d ~ 0.002 for example, we have tp x ~ 0.66, p y ~ 0.002 and uo + pa 
uj_ ~ 0.37. Eqs. (23) and (24) show that both Re(cos#) and Im(cos#) can in principle be 
determined or constrained by measuring the decay rates R(lfX^, t x ; l 2 X 2 , t 2 ) C) provided 
the AB = —AQ transitions and other new-physics effects are negligibly small. These 
formulas are also applicable for the D°-D° mixing system. 



4 Summary 

Keeping with the great experimental interest in testing discrete symmetries and con- 
servation laws at the present and future 5-meson factories, we have reformulated the 
time-dependent and time-integrated rates of coherent (B q B q ) c decays (q = d or s) by 
assuming small CPT violation in B q -B q oscillation. Our results are new and generic, 



9 



and thus they can serve as the master formulas for the analysis of possible CPT- violating 
effects in both the B®-B® mixing system at the T(4S) resonance and the B° s -B® mixing 
system at the T(5S) resonance. Taking the opposite-sign dilepton events for example, 
we have shown that it is possible to separately determine or constrain the parameters of 
CPT violation and AB = —AQ transitions by measuring their time distributions in the 
C = +1 case. In the C = — 1 case, however, the CPT- violating and AB = —AQ effects 
have the same time-dependent behavior and are in general indistinguishable. 

We expect that a stringent test of CPT symmetry and the AB = AQ rule will finally 
be realized at a super- 5 factory with the luminosity C ~ a few x 10 36 cm _2 s _1 , where other 
kinds of new physics may also be explored. The prospect of such ambitious experiments 
is by no means dim, indeed. 

Finally let us mention the evidence for D°-D° mixing achieved in the BaBar [30] and 
Belle [31] experiments. It turns out that the mixing parameter y D is at the one percent 
level and \x D \ < \y D \ is expected to hold [32]. Therefore it seems possible to test CP, T 
and CPT symmetries in the charm system in the (far) future. As we have emphasized 
before, the master formulas obtained in this paper can all be used to describe coherent 
D°D° decays with small CPT violation and (or) small AC = — AQ effects. 

This work was supported in part by the National Natural Science Foundation of China. 
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